
DESCRIPTION 

DATA MATCHING METHOD, DATA MATCHING APPARATUS AND 

DATA MATCHING PROGRAM 

■ 

5 

Technical Field 

The present invention relates to a data 
matching method and a data matching system 
(apparatus) which is applied to an object whose state 

10 changes and matches a data of a state change object 
at a certain time with a data at a different time of 
the object. Also, the present invention relates to 
a data matching program which is applied to an object 
whose state changes and matches a data of a state 

15 change object at a certain time with a data at a 
different time of the object. In particular, the 
present invention relates to a data matching method 
and a data matching system (apparatus) which match 
from an image and voice of biometrics information such 

20 as a face, a voiceprint or the like of a person at 
a certain time, an image and voice at a different time 
of the biometrics information, and relates to a data 
matching program which matches from an image and voice 
of biometrics information such as a face, a voiceprint 

25 or the like of a person at a certain time, an image 
and voice at a different time of the biometrics 
information . 
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Background Art 

When matching is executed for a data of an 
object whose state changes, there may be a trouble 
5 at a matching of a data of certain time with a data 
at a different time. For example, in the case of the 
data with regard to the object whose state changes 
as represented by biometrics information, such as the 
face, voice and the like of a person, ageing causes 

10 the loss of the feature of the youth, and the feature 
after the ageing appears, or the change in emotion 
causes the feature of the face and voice to be 
unno t i c eab 1 e , or the other feature to be outstanding. 
Thus, the data in the state at a certain time is 

15 different from the data in the state at the other time 
even in the data of the same object, and may possibly 
result in the trouble at the matching. 

As an example of the method of generating the 
data after the shape is changed by adding a feature 

20 from the data at a certain time, a method of generating 
the face image after the ageing from the face in the 
younger age when the aging is added to the face image. 
For example, a computer graphics (CG) is used to draw 
the feature after the ageing, such as wrinkle and the 

25 like, to the face in the younger age and consequently 
generate the face image after the ageing from the face 
in the younger age. 
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Also, in U.S. Patent No. 6556196, an image 
processing method is described, which in a case of 
processing a face image, refines the addition of an 
aging feature' and an expression feature to an tmage 
5 by using a three-dimensional model, and can add even 
the unclear feature to the image. By this image 
processing method, a typical model of a deformable 
face is generated from a three-dimensional face data 
stored in a face database and an input face image is 

10 pasted on a generated model. Then, in order to give 
a feature change including the state change, a modeler 
is used to deform the model. 

In Japanese Laid Open Patent Application 
(JP-P 2000-132 675A) , a face identifying and matching 

15 method is described, which is characterized by 

studying in advance the feature of an image variation 
caused by a difference in photographing conditions 
or photographing timing for each classified class, 
and selecting a class from a difference between two 

20 face images where. at least one of the photographing 
condition and the photographing timing is different, 
and determining the feature amount where the feature 
amount of the image variation in the class selected 
from the two face images is reduced, respectively, 

25 and then executing the face identification and 

matching in accordance with the feature amounts of 

♦ 

the two face images. 
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In Japanese Laid Open Patent Application 
(JP-P 2003-233671A) , a method of estimating a 
development of at least one state in a body outer 
surface portion of a target person is described, by 
5 which a first data indicating at least one state is 
received, a second data to reflect how at least one 
state on the body outer surface is expected to be 
developed in association with a time elapse is 
received, and an estimation development of at least 
10 one state in accordance with the first data and the 
second data is generated and then the estimation 
development to the target person is sent. 

Disclosure of Invention 

15 In the case of matching the data by adding a 

feature to generate a state changed data, the 
procedure for generating the feature change caused 
by the aging, the expression change or the like is 
not always established. When the generating 

20 procedure for the feature change is not established, 
a human must imitate an actually existing feature and 
write on the data. Thus, a manual process or a 
semi-automatic process which requires an effort close 
to the manual work must be executed. 

25 Also, in the case that the data is matched by 

using the state change data generated by adding a 
feature, differently from the drawing of the local 
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relatively clear feature, the addition of the state 
change that is global and difficult to grasp 
intuitively by drawing on is difficult. Thus, the 
state change that is global and difficult to grasp 
5 intuitively is difficult to treat. 

In the image processing method noted in U.S. 
Patent No. 6556196, a pre-prepared sample is used and 
the state feature is given to the image. Thus, even 
in the case of generating the face image of arbitral 

10 person, the feature of the same state change is 

generated on the same portion. For example, in the 
case of generating the face image of arbitral person, 
the same wrinkle is generated on the same portion. 

Also, in the image processing method noted in 

15 U.S. Patent No. 6556196, the usage where the state 
feature suitable for the matching face is added is 
not assumed. Thus, whether or not the generated 
sample has the state feature suitable for the face 
matching is uncertain. Hence, there is a possibility 

20 that a face image to which an unnatural state feature 
is added is generated. 

. Also, the image processing method described 
in U.S. Patent No. 6556196 does not assume the purpose 
where the state change is added to the image by 

25 determining the change given to the image which is 
corresponding to the state. Thus, when the state 
change to be added to the image is determined, the 
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work load on a user is heavy. 

It is therefore a subject of the present 
invention to provide a data matching method, a data 
matching apparatus and a data matching program which, 
5 for generating a state changed data, use for matching 
the state changed data where the peculiarity of an 
object is considered in accordance with the relative 
relation of the same object, and can consequently 
improve the matching performance of the data 

10 involving the state change. 

Also, the present invention has the subject 
to provide a data matching method, a data matching 
apparatus and a data matching program which add a 
statistical state change to the data before the state 

15 change, and use for the matching of the state change 
data to which the feature of the global state change 
is added, and can consequently improve the matching 
performance of the data involving the state change. 

Also, the present invention has the subject 

20 to provide a data matching method, a data matching 
apparatus and a data matching program which give a 
correspondence of a configuration component between 
respective categories and use for the matching of the 
state change data to which a typical state change for 

25 each age is added, and can consequently improve the 
matching performance of the data at a particular 
state . 
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Moreover, the present invention has the 
subject to provide a data matching method, a data 
matching apparatus and a data matching program which 
can add the statistical state change to the data prior 
5 to the state change and automatically generate the 
state change data to be generated at the time of the 
matching and can suppress the load on a worker at the 
time of the data matching. 

A data matching method according to the 

10 present invention includes: a configuration 
component accumulation step accumulating a 
configuration component generated by decomposing a 
measuring quantity of an object by a predetermined 
method and a plurality of states of the object each 

15 of which is corresponding to the configuration 
component; a component decomposition step 
decomposing a measuring quantity of a matching target 
object into the configuration component at a 
predetermined state of the plurality of states; a 

20 parameter conversion step converting a parameter 

corresponding to the configuration component of the 
predetermined state into a converted parameter of a 
second state of the plurality of states different from 
the predetermined state; a state change data 

25 generating step generating a state change data by 
adding a predetermined state change to a data of the 
matching target object by using the configuration 
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component accumulated in the configuration component 
accumulation step and the converted parameter; and 
a matching step matching the state change data and 
a matching data accumulated in advance. Under such 
5 configuration, the data generated by adding the state 
information to an input data is used for executing 
the matching. As a result, the matching performance 
of the data involving the state change is improved. 

In the data matching method according to the 

10 present invention, the predetermined method is the 
principal component analysis . 

A data matching method according to the 
present invention includes: a configuration 
component accumulation step accumulating a 

15 configuration component generated by decomposing a 
measuring quantity of an object by a predetermined 
method and a plurality of states of the object each 

■ 

of which is corresponding to the configuration 
component; a connecting step connecting a parameter 

20 corresponding to the configuration component at a 
first state of the plurality of states and a parameter 
corresponding to the configuration component at a 
second state through a conversion using a learning; 
a state change data generation step generating a state 

25 change data of the second state by converting a data 
of the matching target object at the first state 
through a conversion using the learning; and a 
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matching step matching the state change data and a 
matching data accumulated in advance. According to 
such configuration, the matching performance of the 
data involving the state change is improved.- 
5 Moreover, the configuration of the data matching 
apparatus is simplified. The "learning" implies the 
generation of a face image, for example, in accordance 
with the conversion using a neural network, by 
defining s t a t e - sp e c i f i c data of a same person as a 

10 learning data. 

In the data matching method according to the 
present invention, the data of the matching target 
is a biometrics data of human being. The biometrics 
data means, for example, an image of a portion of a 

15 human body exempl ified as the face and the fingerprint, 
the one-dimensional data of the voice such as sound 
and the like, and the three-dimensional data of the 
face shape . 

In the data matching method according to the 
20 present invention, 'each of the plurality of states 
corresponds to a state at a different time through 
a course of aging. 

In the data matching method according to the 
present invention, the measuring quantity is an image 
2 5 of a face. 

The data matching apparatus according to the 
present invention is a computer having a function of 
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executing each of the steps included in the data 
matching method according to the present invention. 
The data matching program according to the present 
invention instructs the computer to execute the data 
5 matching method according to the present invention. 

The data matching method according to the 
present invention is the data matching method for 
matching the data of the object of the matching target 
with the data included in a data group and 

10 corresponding to the object of the matching target 
and is characterized by including: a matching data 
accumulating step of accumulating in advance the data 
group registered for the matching; a component 
decomposing step of decomposing the data of the 

15 matching target into the configuration component in 
a predetermined state;, a parameter converting step 
of converting the parameter corresponding to the 
configuration component in the predetermined state 
into a parameter (attained by coefficients ci, di of 

20 the configuration component) in a state different 
from the predetermined state; a state change data 
generating step of accumulating the configuration 
component of the data classified into each state, and 
using the accumulated configuration component and the 

25 parameter converted at the parameter converting step, 
and then generating the state change data where a 
predetermined state change is given to the data of 
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the matching target; and a matching step of matching 
the state change data generated at the state change 
data generating step with a matching data group 
accumulated at the matching data accumulating step. 
5 Also, the data matching method is the data 

matching method, which matches the data of the object 
of the matching target with the data included in the 
data group and corresponding to the object of the 
matching target and may include: a matching data 

10 accumulating step of accumulating in advance the data 
group registered for the matching; a state change data 
generating step of generating the state change data 
where the data in the predetermined state is changed 
into the data in the different state from the 

15 predetermined state, in accordance with the 

conversion formed through the learning through the 
data classified into each state; and a matching step 
of matching the state change data generated at the 
state change data generating step with the matching 

20 data group accumulated at the matching data 
accumulating step. 

Also, the data matching method is the data 
matching method, which matches the biometrics data 
of a person with the biometrics data included in the 

25 data group and corresponding to a person and may 
include: the matching data accumulating step of 
accumulating in advance the data group registered for 
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the matching; a component decomposing step of 
decomposing the biometrics data of the matching 
target into the configuration component in the 
predetermined state; the parameter converting step 
5 of converting the parameter corresponding to the 
configuration component in the predetermined state 
into the parameter in the state different from the 
predetermined state; the state change data generating 
step of accumulating the configuration component of 

10 the biometrics data classified into each state, and 
using the accumulated configuration component and the 
parameter converted at the parameter converting step, 
and then generating the state change data where the 
predetermined state change is given to the biometrics 

15 data of the matching target; and the matching step 
of matching the state change data generated at the 
state change data generating step with the matching 
data group accumulated at the matching data 
accumulating step. 

20 Also, the data matching method is the data 

matching method, which matches the biometrics data 
of the person with the biometrics data included in 
the data group and corresponding to a person and may 
include: the matching data accumulating step of 

25 accumulating in advance the data group registered for 
the matching; the state change data generating step 
of generating the state change data where the 
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biometrics data in the predetermined state is changed 
into the biometrics data in the state different from 
the predetermined state, in accordance with the 
conversion formed through the learning through the 
5 biometrics data classified into each state; and the 
matching step of matching the state change data 
generated at the state change data generating step 
with the matching data group accumulated at the 
matching data accumulating step. 

10 Also, in the data matching method, the 

component decomposing step decomposes the biometrics 
data into the configuration component after the 
predetermined ageing, and the parameter converting 
step converts the parameter corresponding to the 

15 configuration component after the predetermined 

ageing into the parameter after the ageing different 
from the predetermined ageing, and the state change 

* 

data generating step accumulates the configuration 
component of the biometrics data classified into each 

20 ageing, and uses the accumulated configuration 
component and the parameter converted at the 
parameter converting step, and then generates the 
aging data (attained by the state change data) where 
the predetermined aging is given to the biometrics 

25 data, and the matching step matches the aging data 
generated at the state change generating step with 
the matching data group accumulated at the matching 
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data accumulating step. 

Also, in the data matching method, the state 
change data generating step generates the aging data 
where the biometrics data after the predetermined 
5 ageing is changed into the biometrics data after the 
ageing different from the predetermined ageing, in 
accordance with the conversion formed through the 
learning through the biometrics data classified into 
each ageing, and the matching step matches the aging 

10 data generated at the state change generating step 
with the matching data group accumulated in the 
matching data accumulating step. 

Also, the data matching method is the data 
matching method of matching a face image of a person 

15 of a matching target with a face image included in 
a face image group and corresponding to a person and 
may include: a matching data accumulating step of 
accumulating in advance the face image group 
registered for the matching; a component decomposing 

20 step of decomposing the face image into the 
configuration component in a predetermined 
expression; a parameter converting step of converting 
a parameter corresponding to the configuration 
component in the predetermined expression into a 

25 parameter in the expression different from the 

predetermined expression; an expression change data 
generating step of accumulating the configuration 
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component of the face image classified into each 
expression, and using the accumulated configuration 
component and the parameter converted at the 
parameter converting step and then generating an 
5 expression change data (attained by the state change 
data) where a predetermined expression change is 
given to the face image; and the matching step of 
matching the expression change data generated at the 
expression change data generating step with the 

10 matching data group accumulated at the configuration 
component accumulating step. 

Also, the data matching method is the data 
matching method of matching the face image of a person 
of the matching target with the face image 

15 corresponding to the person included in the face image 
group and may include the matching data accumulating 
step of accumulating in advance the face image group 
registered for the matching; the expression change 
data generating step of generating the expression 

20 change data where the face image in the predetermined 
expression is changed into the face image in the 
expression different from the predetermined 
expression, in accordance with the conversion using 
the study through the face image classified into each 

25 expression; and the matching step of matching the 
expression change data generated at the expression 
change data generating step with the matching data 
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group accumulated at the matching data accumulating 
step. 

The data matching apparatus according to the 
present invention is the data matching apparatus 
5 which matches the data of the object of the matching 
target with the data corresponding to the object of 
the matching target included in the data group and 
is characterized by including: a component 
decomposing unit (attained by a component analyzing 

10 unit 101) for decomposing the data of the matching 
target into the configuration component in the 
predetermined state; a parameter converting unit 
(attained by a component coefficient converting unit 
103) for converting the parameter corresponding to 

15 the configuration component in the predetermined 

state into the parameter in the different state from 
the predetermined state; a state change data 
generating unit (attained by a state change data 
generating unit 102) for accumulating the 

20 configuration component of the data classified into 
each state, and using the accumulated configuration 
component and the parameter converted by the 
parameter converting unit and then generating the 
state change data where a predetermined state change 

25 is given to the data of the matching target; a matching 
data accumulating unit (attained by a matching data 
accumulating unit 104) for accumulating in advance 
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the data group registered for the matching; and a 
matching unit (attained by a matching unit 105) for 
matching the state change data generated by the state 
change data generating unit with the matching data 
5 group accumulated by the matching data accumulating 
unit. 

Also, the data matching apparatus is the data 
matching apparatus, which matches the data of the 
object of the matching target with the data included 

10 in a data group and corresponding to the object of 
the matching target and may include: a state change 
data generating unit (attained by a state change data 
generating unit 102b) for generating the state change 
data where the data in the predetermined state is 

15 changed into the data in the state different from the 
predetermined state, in accordance with the 
conversion using the study through the data 
classified into each state; the matching data 
accumulating unit for accumulating in advance the 

20 data group registered for the matching; and the 
matching unit for matching the state change data 
generated by the state change data generating unit 
with the matching data group accumulated by the 
matching data accumulating unit. According to such 

25 configuration, it is possible to improve the matching 
performance of the data involving the state change 
and also possible to simplify the configuration of 
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the data matching apparatus. 

Also, the data matching apparatus is the data 
matching apparatus, which matches the biometrics data 
of the person with the biometrics data corresponding 
5 to the person included in the data group and may 
include: the component decomposing unit for 
decomposing the biometrics data of the matching 
target into the configuration component in the 
predetermined state; the parameter converting unit 

10 for converting the parameter corresponding to the 
configuration component in the predetermined state 
into the parameter in the state different from the 
predetermined state; the state change data generating 
unit for accumulating the configuration component of 

15 the biometrics data classified into each state, and 
using the accumulated configuration component and the 
parameter converted by the parameter converting unit, 
and then generating the state change data where the 
predetermined state change is given to the biometrics 

20 data of the matching target; the matching data 

accumulating unit for accumulating in advance the 
data group registered for the matching; and the 
matching unit for matching the state change data 
generated by the state change data generating unit 

25 with the matching data group accumulated by the 
matching data accumulating unit. 

Also, the data matching apparatus is the data 
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matching apparatus, which matches the biometrics data 
of a person with the biometrics data included in the 
data group and corresponding to a person and may 
include: the state change data generating unit for 
5 generating the state change data where the biometrics 
data in the predetermined state is changed into the 
biometrics data in the different state from the 
predetermined state, in accordance with the 
conversion using the study through the biometrics 

10 data classified into each state; the matching data 
accumulating unit for accumulating in advance the 
data group registered for the matching; and the 
matching unit for matching the state change data 
generated by the state change data generating unit 

15 with the matching data group accumulated by the 
matching data accumulating unit. 

Also, the component decomposing unit 
decomposes the biometrics data into the configuration 
component after the predetermined ageing, the 

20 parameter converting unit converts the parameter 

corresponding to the configuration component after 
the predetermined ageing into the parameter after the 
ageing different from the predetermined ageing, the 
state change data generating unit accumulates the 

25 configuration component of the biometrics data 

classified into each ageing, and uses the accumulated 
configuration component and the parameter converted 
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by the parameter converting unit, and then generates 
the aging data where the predetermined aging is given 
to the biometrics data, and the matching unit matches 
the aging data generated by the state change 
5 generating unit with the matching data group 

accumulated by the matching data accumulating unit. 

Also, the state change data generating unit 
may generate the aging data where the biometrics data 
after the predetermined ageing is changed into the 

10 biometrics data after the ageing different from the 
predetermined ageing, in accordance with the 
conversion formed through the learning through the 
biometrics data classified into each ageing, and the 
matching unit may match the aging data generated by 

15 the state change generating unit with the matching 
data group accumulated by the matching data 
accumulating unit. 

Also, the data matching apparatus is the data 
matching apparatus for matching the face image of a 

20 person of the matching target with the face image 
included in the face image group and corresponding 
to a person and may include: a component decomposing 
unit for decomposing the face image into the 
configuration component in the predetermined 

25 expression; a parameter converting unit for 

converting the parameter corresponding to the 
configuration component in the predetermined 
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expression into the parameter in the expression 
different from the predetermined expression; an 
expression change data generating unit (attained by 
the state change data generating unit 102) for 
5 accumulating the configuration component of the face 
image classified into each expression, and using the 
accumulated configuration component and the 
parameter converted by the parameter converting unit 
and then generating the expression change data where 

10 the predetermined expression change is given to the 
face image; the matching data accumulating unit for 
accumulating in advance the face image group 
registered for the matching; and the matching unit 
for matching the expression change data generated by 

15 the expression change data generating unit with the 
matching data group accumulated by the configuration 
component accumulating unit. 

Also, the data matching apparatus is the data 
matching apparatus, which matches the face image of 

20 a person of the matching target with the face image 
included in the face image group and corresponding 
to the person and may include: an expression change 
data generating unit (attained by the state change 
data generating unit 102b) for generating the 

25 expression change data where the face image in the 
predetermined expression is changed into the face 
image in the expression different from the 
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predetermined expression, in accordance with the 
conversion using the study through the face image 
classified into each expression; the matching data 
accumulating unit for accumulating in advance the 
5 face image group registered for the matching; and the 
matching unit for matching the expression change data 
generated by the expression change data generating 
unit with the matching data group accumulated by the 
matching data accumulating unit. 

10 The data matching program according to the 

present invention is the data matching program which 
matches the data of the object of the matching target 
with the data included in a data group and 
corresponding to the object of the matching target 

15 and is characterized by instructing a computer having 
the matching data accumulating unit for accumulating 
in advance the data group registered for the matching 
to execute: a process for decomposing the data of the 
matching target into the configuration component in 

20 the predetermined state; a process for converting the 
parameter corresponding to the configuration 
component in the predetermined state into the 
parameter in the state different from the 
predetermined state; a process for accumulating the 

25 configuration component of the data classified into 
each state, and using the accumulated configuration 
component and the converted parameter and then 
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generating the state change data where the 
predetermined state change is given to the data of 
the matching target; and a process for matching the 
generated state change data with the matching data 
5 group accumulated by the matching data accumulating 
un i t . 

Also, the data matching program is the data 
matching program which matches the data of the object 
of the matching target with the data included in a 

10 data group and corresponding to the object of the 
matching target and instructs the computer having the 
matching data accumulating unit for accumulating in 
advance the data group registered for the matching 
to execute: a process for generating the state change 

15 data where the data in the predetermined state into 
the data in the state different from the predetermined 
state, in accordance with the conversion formed 
through the learning by using the data classified into 
each state; and the process for matching the generated 

20 state change data with the matching data group 

accumulated by the matching data accumulating unit. 
According to such configuration, it is possible to 
improve the matching performance of the data 
involving the state change and also possible to 

25 simplify the configuration of the data matching 
apparatus . 

According to the present invention, the state 
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change data is generated to then execute the matching. 
Thus, for the state change object, only the data of 
the object at the certain time can be used to execute 
the matching of the high precision. Thus, when the 
5 state change data is generated, in accordance with 
the relative relation of the same object, the state 
change data where the peculiarity of the object is 
considered is used for the matching. Hence, it is 
possible to improve the matching performance of the 

10 data involving the state change. 

According to the present invention, even if 
there is only the biometrics data such as the image, 
the voice and the like at a certain time, by generating 
the data at the time of the state change and then 

15 matching with the registration information, it is 
possible to improve the performance of the matching 
of the person identification, the crime investigation, 

* 

the academic investigation or the like in a security 
s y s tern . 

20 

Brief Description of Drawings 

Fig. 1 is a block diagram showing an example 
of the configuration of a data matching apparatus 
according to the present invention; 
25 Fig. 2 is a flowchart showing an example of 

the data matching process where the data matching 
apparatus matches a face image; 



- 25 - 

Fig. 3 is a block diagram showing another 
example of the configuration of the data matching 
apparatus; 

Fig. 4 is a flowchart showing another example 
5 of the data matching process where the data matching 
apparatus matches the face image; 

Fig. 5 is a block diagram showing an example 
of the configuration of the component analyzing 
apparatus ; 

10 Fig. 6 is a block diagram showing an example 

of the configuration of the state change generating 
apparatus ; 

Fig. 7 is a block diagram showing an example 
of the configuration of the component coefficient 
15 converting apparatus; and 

Fig. 8 is a block diagram showing an example 
of the configuration of the state change data 
generating apparatus. 



20 Best Mode for Carrying Out the Invention 

THE FIRST EMBODIMENT. 

The first embodiment of the present invention 
will be described below with reference to the drawings. 
Fig. 1 is a block diagram showing an example of the 
25 configuration of the data matching apparatus 

according to the present invention. Here, the case 
where the shape is changed through the aging, a face 
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image is used as a state change data/ and the data 
matching apparatus is used for matching a face image 
at a certain time with a face image at a different 
time is explained. 
5 The state change is not limited to the aging. 

Then, the data matching apparatus may be the apparatus 
for matching the data involving the different state 
change such as the expression change of a face and 
the like. Also, the state change data is not limited 

10 to the face image, and may be the data such as the 
image of the various portions of the h urn an body, a 
fingerprint and the like, the o n e - d i me n s i o n a 1 data 
such as the voice, sound and the like, and the 
three-dimensional biometrics data of a face shape and 

15 the like. Also, the state change data may be the data 
of an animal other than the human and a plant and the 
data with regard to the object that is aged while 

< 

having the individual property similarly to a living 
thing . 

20 As shown in Fig. 1, the data matching 

apparatus includes: a component analyzing unit 101 
for analyzing the component of an input data 11; a 
state change data generating unit 102 for generating 
a state (ageing) change data of the input data 11; 

25 a component coefficient converting unit 103 for 
correlating between the databases of respective 
states (ageing); a matching data accumulating unit 
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104 for accumulating in advance the matching data; 
and a matching unit 105 for matching the state 
(ageing) change data with the data accumulated by the 
matching data accumulating unit 104. 
5 Also, the state change data generating unit 

102 has a plurality of s t a t e - s p e c i f i c (ageing- 
specific) databases DB 1 , DBi, DBn, which 
accumulate the configuration components of the data 
classified into respective states (ageing) . Each of 

10 the databases accumulates the configuration 

component obtained by decomposing the measuring 
quantity of an object by using a predetermined method 
such as the principal component analysis and the like. 
Hereafter, for comprehensively representing the 

15 s t a t e - spe c i f i c databases DBI to DBn , or for 

representing any of the s t a t e - s p e c i f i c databases, we 
refer merely as the s t a t e - sp e c i f i c database. 

In this embodiment, the matching data 
accumulating unit 104 is realized by, for example, 

20 a magnetic disc device. The component analyzing unit 
101, the component coefficient converting unit 103 
and the matching unit 105 are realized by, for example, 
a central processor in a computer and a program 
executed by the central processor. The state change 

25 data generating unit 102 is realized by, for example, 
the magnetic disc device, the central processor in 
the computer and the program executed by the central 
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processor . 

The component analyzing unit 101 has a 
function for r e - c o n f i gu r i ng the face image so that 
the deviation is the smallest, by using the 
5 configuration component in the state-specific 
database Bi corresponding to state (ageing) 
information 12 of the face image which is the input 
data 11. In this embodiment, the component analyzing 
unit 101 selects the s t a t e - s p e c i f i c database Bi 
10 corresponding to the state of the face image of the 
input data 11, for example, in accordance with the 
state information 12 inputted by the state change data 
generating unit 102, and r e - c o n f i gu r e s the face 
image . 

IS For example, when the component analysis is 

executed, a linear component analysis such as the 
principal component analysis and the like is used in 
many cases. When the face image is configured in the 
linear coupling of principal components, the face 

20 image is represented by the equation (1) . 
Equation ( 1 ) : 
Ip=clPl+c2P2+ . . ,+cmPm 

(Pi: Principal component, ci: Coefficient) 

In this embodiment, as the component 
25 analyzing unit 101, a minimum deviation coefficient 
set ci where the deviation from an input face image 
10 is the smallest is selected from the face images 
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represented by the equation (1). The component 
analyzing unit 101 sends the selected minimum 
deviation coefficient selection set ci through the 
state-specific databases DBi of the state change data 
5 generating unit 102 to the component coefficient 
converting unit 103. 

The state change data generating unit 102 has 
the plurality of state-specific databases DBI, . 
DBi, DBn that accumulate the configuration 

10 components of the data classified into the respective 
states (ageing). Also, the state change data 
generating unit 102 has a function for passing a 
coefficient set ci corresponding to each state- 
specific database calculated by the component 

15 analyzing unit 101 to the component coefficient 
converting unit 103. 

Also, the state change data generating unit 
102 has a function for r e - co n f i gu r i n g the face image 
by using: a coefficient set di converted by the 

20 component coefficient converting unit 103 for the 
st ate- speci f ic database which is different from the 
s t a t e - spe c i f i c databases selected by the component 
analyzing unit 101; and the configuration component 
inside the different s t a t e - s p e c i f i c database. Also, 

25 the state change data generating unit 102 has a 

function for sending a r e - co n f i g u r a t i o n face image 
Jp as a state (ageing) change data to the matching 
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unit 105. The re-configuration face image Jp is 
represented by using an equation (2) as the linear 
coupling of the coefficient set di in a principal 
component Qi inside the s t a t e - s p e c i f i c database, when 
5 the principal component analysis is used. 
Equation ( 2 ) : 
Jp=dlQl +d2Q2+ . . . +dmQm 

The s t a t e - spe c i f i c database Bi accumulates 
the components, which are generated by converting 

10 into major elements {Ul, U2 , . .., U j , Up} among 

the elements constituting each image, from face 
images {Al, A2 , Ai, Ap } in a certain age, 

through a predetermined calculation, as the 
configuration components. For example, in the case 

15 of using the principal component analysis, the 

s t a t e - spe c i f i c database accumulates the value, which 
is obtained by singular value decomposition of the 

< 

matrix where a pixel Ai (x, y) of each image is arranged 
as a column vector, as the configuration component. 
20 In this case, the matrix where the pixel Ai (x, y) 
of each image is arranged as the column vector is 
represented by an equation (3) . 
[ Nume r a 1 1 ] 
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The s t a t e - spe c i f i c database accumulates, as 
the configuration components, the former p column 
vectors {Ul, U2, Uj , Up} of an orthogonal 

5 matrix obtained by applying the singular value 

decomposition represented by the equation (4) to the 
matrix represented by the equation (3) 

■ 

Equa t ion ( 4 ) : 
A=USV t 

10 By the way/ in the equation (4), S is the 

matrix where the elements except diagonal components 
are 0, and the diagonal components are arranged in 
a descending order of an absolute value. 

Also, in order to correlate the respective 

15 s t a t e - s p e c i f i c databases, between the two state- 
specific databases, the face images of the same 
persons are generated in advance correspondingly to 



- 32 - 

the number of the components to be used, respectively. 
For example, when 30 configuration components are 
used, in the two s t a t e - s p e c i f i c databases, the face 
images in both of the states (ageing) are generated 
5 correspondingly for 30 or more persons, and the 

configuration components of the respective state- 
specific databases are generated and accumulated in 
advance . 

The component coefficient converting unit 
10 103 has a function for converting a coefficient that 
is multiplied to the configuration component of the 
s t a t e - spe c i f i c database. For example, the case of 
using the principal component analysis is 
ex emp 1 i f i e d . 

15 For example, the two state-specific 

databases DBi, DBj are used, and the principal 
components of the databases DBi, DBj are assumed to 

* 

be Pi (i = l, .... n) and Qj (j = l, n), respectively, 

and the coefficients of the principal components are 

20 assumed to be ci (i = l, n) and dj (j = l, n), 

respectively. In this case, in order to convert from 
the coefficient ci to the coefficient d j , a plurality 
of face images Ip, Jp belonging to both of the states 
(ageing) respectively corresponding to the databases 

25 DBi, DBj under the faces of the same persons are used. 
Here, the face images Ip, Jp are represented by 
equations (5) and (6) respectively, by using the 
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e qu a t i on ( 1 ) . 

Equation (5) : 

Ip=c 1 P 1 +c2 P2+ ... +cnPn 

Equation ( 6 ) : 

Jp=dlQl+d2Q2+ . . . + dnQn 

Thus, supposing that the conversion from the 
coefficients ci to the coefficients dj is a linear 
conversion T, and supposing a coefficient set of a 
person A is represented by {CiA, D j A } , a coefficient 
set of a person B is represented by {CiB, D j B } and 
so on. Then, the coefficient set of the person B {CiB, 
DjB} etc. is represented by an equation (7) . 
Equa t ion ( 7 ) : 

[DjA, DjB, ...] = T[CiA, CiB, ...] 

Here, in the equation (7) , CiA and DjA are the 
column vectors where the coefficients ci, di in the 
equation (4) and the equation (5) are vertically 
arranged. Thus, the linear conversion T can be 
calculated by using an equation (8), when C=[CiA, 
CiB, ...] and D=[D]A, DjB, ...] are assumed. 
E qua t ion ( 8 ) : 
T = DC t (CCM 

The component coefficient converting unit 
103 may execute the conversion from ci to dj by using 
a nonlinear conversion. For example, the component 
coefficient converting unit 103 may define the 
coefficient set {ci, d j } , in which they correspond 
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to the databases DBi, DBj in the faces of the same 
persons, respectively, as the learning data, and 
execute the coefficient conversion by using the 
neural network. 
5 The matching data accumulating unit 104 is a 

database for accumulating the data for the matching 
and accumulates in advance the data registered for 
the matching. The matching data accumulating unit 

104 is realized by, for example, a data storage unit 

■ 

10 of the usual matching apparatus. The matching data 
accumulating unit 104 accumulates in advance the data 
groups for a current face image of a person and a face 
image having no expression, for example, as the data 
for the matching. 

15 The matching unit 105 having a function for 

comparing and matching the state change data 
generated by the state change data generating unit 
102 with the registration data accumulated by the 
matching data accumulating unit 104 and outputting 

20 a matching result 18. For example, the matching unit 

105 determines the difference between the state 
(ageing) change data and the registration data and 
judges the data, in which the determined difference 
is the smallest, as the data of the person itself. 

25 The method is not limited to those using the 

difference. The matching unit 105 can execute the 
matching by using the other matching method. 
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Also, the matching unit 105 matches the 
plurality of state change data generated by the state 
change data generating unit 102 with the registration 
data, as shown in Fig. 1. Thus, the matching unit 105 
5 matches the plurality of state change data with the 
registration data, and then regards the data, which 
has the minimum difference among the entire 
differences, as the data of the person itself, and 
can consequently execute the matching corresponding 

10 to the state (ageing) change. When the state (ageing) 
of the data accumulated by the matching database (the 
matching data accumulating unit 104) is known, the 
matching unit 105 may match the state change data of 
only the state (age) corresponding to the 

15 registration data with the registration data. If so, 
a matching time can be reduced. 

The operations will be described below. Fig. 
2 is the flowchart showing an example of the data 
matching process where the data matching apparatus 

20 matches the face image. The component analyzing unit 
101 inputs the input data 11 of a matching target, 
in accordance with an input operation by a user (Step 
S101) . In this example, the component analyzing unit 

101 inputs the face image of the matching target as 
25 the input data 11. 

Also, the state change data generating unit 

102 inputs the state information 12 indicating the 
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state of the input data 11, in accordance with the 
input operation of the user (Step S102) . For example, 
the state change data generating unit 102 inputs the 
year and year zone (age) of the person of the face 
5 image in the input data 11. Also, for example, the 
state change data generating unit 102 inputs the 
information indicating the expression of the face 
image in the input data 11, such as the feeling and 
the like, as the state information 12. 

10 The component analyzing unit 101 selects the 

s t a t e - spe c i f i c database Bi corresponding to the state 
of the input data 11 of the matching target, in 
accordance with the state information 12, from the 
state-specific databases DB of the state change data 

15 generating unit 102 (Step S103) . Also, the component 
analyzing unit 101 extracts the configuration 
component from the selected s t a t e - s p e c i f i c database, 
analyzes the input data 11 and calculates a 
configuration component coefficient (Step S104) . 

20 Also, the component analyzing unit 101 sends the 
calculated configuration component coefficient 
through the s t a t e - spe c i f i c database in the state 
change data generating unit 102 to the component 
coefficient converting unit 103. 

25 The component coefficient converting unit 

103 converts the configuration component coefficient 
calculated by the component analyzing unit 101, into 
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the configuration component coefficient 
corresponding to the state-specific database other 
than the s t a t e - s p e c i f i c database selected by the 
component analyzing unit 101 (Step S105) . The state 
5 change data generating unit 102 extracts the 

configuration component from the s t a t e - s p e c i f i c 
database corresponding to the configuration 
component coefficient after the conversion and 
generates the state change data in accordance with 

10 the configuration component coefficient converted by 
the component coefficient converting unit 103 and the 
extracted configuration component (Step S106) . 

The matching unit 105 extracts the 
registration data from the matching data accumulating 

15 unit 104. Then, the matching unit 105 matches the 
state change data generated by the state change data 
generating unit 102 with the registration data 
accumulated by the matching data accumulating unit 
104, and outputs the matching result 18 (Step S108) . 

20 As mentioned above, according to this 

embodiment, since the data before the state change 
and after the state change is generated to execute 
the matching, for the state change object, only the 
data of the object at a certain time can be used to 

25 then execute the matching of the high precision. Thus, 
at the time of the generation of the state change data, 
by using for the matching the state change data where 
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the peculiarity of the object is considered on the 
basis of the relative relations of the same object, 
it is possible to improve the matching performance 
of the data involving the state change. 
5 Also, in this embodiment, the feature of the 

object is decomposed into the configuration 
components. Thus, by using even the statistical 
state feature that is difficult to manually represent, 
it is possible to execute the matching of the high 

10 precision. Hence, by using for the matching the state 
change data where the statistical state change is 
added to the data before the state change and the 
feature of the rough state change is also added, it 
is possible to improve the matching performance of 

15 the data involving the state change. 

Also, according to this embodiment, it can be 
processed independently of the time axis. Thus, when 
the process for giving the aging as the state change 
is executed, the matching of the high precision can 

20 be performed on another aging of not only the ageing 
change but also the aging towards the young direction 
and the like. 

Also, according to this embodiment, since the 
state change data in the plurality of states can be 

25 generated and used for the matching, by coping with 
the plurality of state changes, it is possible to 
execute the matching of the high precision. Also, 
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according to this embodiment, by giving the 
correspondence of the configuration component 
between the respective state categories and using for 
the matching the state change data in which the 
5 typical state change in each age is added to the data 
before the state change, it is possible to improve 
the matching performance of the data in the particular 
state . 

Also, according to this embodiment, since the 
10 addition of the state change to be generated at the 

■ 

time of the matching can be automatically executed, 
the burden on the worker at the time of the matching 
can be reduced. Thus, it is possible to add the 
statistical state change to the data before the state 

15 change, and automatically generate the state change 
data to be generated at the time of the matching and 
consequently reduce the burden on the worker at the 
time of the data matching. 

Moreover, according to this embodiment, the 

20 existing many matching systems can be used to realize 
the data matching apparatus. Thus, it is possible to 
easily assemble the system (data matching apparatus) 
and possible to change the system. 
THE SECOND EMBODIMENT. 

25 The second embodiment of the present 

invention will be described below with reference to 
the drawings. Fig. 3 is a block diagram showing 
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another example of the configuration of the data 
matching apparatus. This embodiment differs from 
the first embodiment in that the data matching 
apparatus does not include the component analyzing 
5 unit 101 and the component coefficient converting 
unit 103, in the configuration elements shown in Fig. 
1. Also, in this embodiment, the process of the state 
change data generating unit 102b in the data matching 
apparatus differs from the process of the state change 

10 data generating unit 102 shown in the first 
embodiment . 

In this embodiment, the state change data 
generating unit 102b inputs a face image, which is 
the input data 11, to the s t a t e - sp e c i f i c database 

15 corresponding to the state (ageing) information 12 
of the input data 11. The state change data 
generating unit 102b directly sends the input data 

* 

11 to the other s t a t e - sp e c i f i c databases except the 
s t a t e - spe c i f i c database corresponding to the input 

20 data 11 and generates the face images (state change 
data) of the states (ageing) other than the state of 
the input data 11. Then, the state change data 
generating unit 102b sends the generated face image 
to the matching unit 105. 

25 In this embodiment, the state change data 

generating unit 102b generates the state change data 
by directly converting the face image from a certain 
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state into the other state without using the 
configuration component. For this reason, between 
the respective s t a t e - s p e c i f i c databases, the data 
classified into each state (ageing) of the same person 
5 is accumulated in advance to generate a neural network. 
Then, the state change data generating unit 102b uses 
the pr e-genera t ed neural network and generates the 
converted face image. In this embodiment, for 
example, the state change data generating unit 102b 

10 defines the p r e - a c c umu 1 a t e d s t a t e - s p e c i f i c database 
of the same person as the learning data, and uses the 
neural network and then executes the converting 
process and consequently generates the face image. 

In this embodiment, the large quantity of the 

15 s t a t e - s pe c i f i c data of the same person is required, 
because of the learning in the neural network, as 
compared with the first embodiment. However, the 

* 

configuration of the data matching apparatus can be 
s imp 1 i f i ed . 

2 0 The operations will be described below. Fig. 

4 is a flowchart showing another example of the data 
matching process where the data matching apparatus 
executes the matching of face images. The state 
change data generating unit 102b inputs the input data 

25 11 of the matching target, in accordance with the 
input operation by the user (Step S201) . In this 
embodiment, the state change data generating unit 
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102b inputs the face image of the matching target as 
the input data 11. 

Also, the state change data generating unit 
102b inputs the state information 12 indicating the 
5 state of the input data 11, in accordance with the 
input operation of the user (Step S202) . For example, 
the state change data generating unit 102b inputs the 
year and year zone (age) of the person of the face 
image of the input data 11. Also, for example, the 

10 state change data generating unit 102b inputs the 
information indicating the expression of the face 
image of the input data 11, such as the feeling and 
the like, as the state information 12. 

The state change data generating unit 102b 

15 converts the input data 11 into the state change data 
of the state (age) other than the state of the input 
data 11 (Step S203). In this case, the state change 
data generating unit 102b generates the state change 
data by using the a 1 r e ad y - 1 e a r n e d neural network, in 

20 accordance with the state information 12. 

The matching unit 105 extracts the 
registration data from the matching data accumulating 
unit 104. Then, the matching unit 105 matches the 
state change data generated by the state change data 

25 generating unit 102b with the registration data 

accumulated by the matching data accumulating unit 
104, and outputs the matching result 18 (Step S204) . 
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As mentioned above, according to this 
embodiment, the data matching apparatus, even if the 
component analyzing unit 101 and component 
coefficient converting unit 103 shown in the first 
5 embodiment do not exist, can obtain the effect similar 
to the data matching apparatus indicated in the first 
embodiment. Thus, it is possible to improve the 
matching performance of the data involving the state 
change and also possible to simplify the 

10 configuration of the data matching apparatus. 
THE THIRD EMBODIMENT. 

The third embodiment of the present invention 
will be described below with reference to the drawings. 
This embodiment corresponds to the apparatus where 

15 the data matching apparatus in the first embodiment 
is made into the specific apparatus. In this 
embodiment, the data matching apparatus includes: a 
component coefficient converter where the component 
coefficient converting unit 103 is made into an 

20 apparatus; the state change generator where the state 
change data generating unit 102 is made into an 
apparatus; the component analyzer where the component 
analyzing unit 101 is made into an apparatus; the 
matching data accumulator where the matching data 

25 accumulating unit 104 is made into an apparatus; and 
the matching device where the matching unit 105 is 
made into an apparatus. 
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Fig. 5 is a block diagram showing an example 
of the configuration of the component analyzer 101a 
where the component analyzing unit 101 is made into 
an apparatus. As shown in Fig. 5 / the component 
5 analyzer 101a includes a calculator 101b, an input 
data storage device 101c and a configuration 
component storage device lOld. 

The input data storage device 101c is 
specifically realized by a memory and a magnetic disc 

10 device. The input data storage device 101c has a 
function for accumulating the face image of the input 
data 11. The configuration component storage device 
lOld is specifically realized by a memory and a 
magnetic disc device. The configuration component 

15 storage device lOld has a function for accumulating 
the configuration component sent from the state 
change generator 102a where the state change data 
generating unit 102 is made into an apparatus. 

The calculator 101b is realized by a CPU that 

20 is operated in accordance with a program. The 

calculator 101b carries out the data processing that 
uses the input data 11 and the configuration component. 
The calculator 101b executes the calculating process 
similar to the component analyzing unit 101 shown in 

25 the first embodiment, in accordance with the face 
image accumulated by the input data storage device 
101c and the configuration component accumulated by 
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the configuration component storage device lOld, and 
determines the configuration component coefficient. 
Then, the calculator 101b sends the determined 
configuration component coefficient to the state 
5 change generator 102a. 

Fig. 6 is a block diagram showing an example 
of the configuration of the state change generator 
102a where the state change data generating unit 102 
is made into an apparatus. As shown in Fig. 6, the 

10 state change generator 102a includes a calculator 
102c, a s t a t e - spe c i f i c configuration component 
storage device 102d and a state selector 102e. 

The state selector 102e is specifically 
realized by a semiconductor circuit for switching or 

15 the like. The state selector 102e has a function for 
selecting the state-specific database to extract the 
configuration component to be sent to the component 
analyzer 101a, in accordance with the state 
information 12. The s t a t e - sp e c i f i c configuration 

20 component storage device 102d is specifically 

realized by a memory or a magnetic disc device. The 
s t a t e - s pe c i f i c configuration component storage 
device 102d has a function for accumulating the 
configuration component of a face image for each state. 

25 The calculator 102c is realized by a CPU that is 
operated in accordance with a program. The 
calculator 102c has a function for generating the 
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state change data in accordance with the 
configuration component coefficients and the 
configuration components of the face image for each 
state. 

5 In this embodiment, the state selector 102e 

selects the s t a t e - spe c i f i c database corresponding to 
the state information 12 and extracts the 
configuration component from the selected database 
and then sends to the component analyzer 101a. Also, 

10 the state selector 102e sends the configuration 

component coefficients calculated by the component 
analyzer 101a to a component coefficient converter 
103a where the component coefficient converting unit 
103 is made into an apparatus. The calculator 102c 

15 executes the calculation by using the equation (2), 
in accordance with the configuration component 
coefficient converted by the component coefficient 
converter 103a and the configuration component of the 
s t a t e - s p e c i f i c database corresponding to the 

20 configuration component coefficient after the 

conversion, and generates the state change data. 

Fig. 7 is a block diagram showing an example 
of the configuration of the component coefficient 
converter 103a where the component coefficient 

25 converting unit 103 is made into an apparatus. As 
shown in Fig. 7, the component coefficient converter 
103a includes a calculator 103b. The calculator 103b 
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is specifically realized by a CPU operated in 
accordance with a program. The calculator 103b has 
a function for converting the configuration component 
coefficient from the state change generator 10 2a, 
5 into the configuration component coefficient 
corresponding to the s t a t e - s p e c i f i c database 
different from the s t a t e - sp e c i f i c database 
corresponding to the configuration component 
coefficient. The calculator 103b converts the 

10 configuration component coefficient by using the 
converting method similar to the component 
coefficient converting unit 103 shown in the first 
embodiment . 

The matching data accumulator where the 

15 matching data accumulating unit 104 is made into an 
apparatus is specifically realized by a storage 
device, such as a memory, a magnetic disc device and 

■ 

the like. 

Amatching device 105a where the matching unit 
20 105 is made into an apparatus is different in 

apparatus configuration, depending on the matching 
method. Specifically, this is realized by a computer 
which has a storage device, such as a memory, a 
magnetic disc device and the like, and a calculator, 
25 such as a CPU operated in accordance with a program 
and the like. 
Fourth Embodiment 
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The fourth embodiment of the present 
invention will be described below with reference to 
the drawings. This embodiment corresponds to the 
apparatus where the data matching apparatus in the 
5 second embodiment is made into a specific apparatus. 
In this embodiment, the data matching apparatus 

• * 

includes: the state change generator where the state 

change data generating unit 102 is made into an 

apparatus; the matching data accumulator where the 
10 matching data accumulating unit 104 is made into an 

apparatus; and the matching device where the matching 

unit 105 is made into an apparatus. 

In this embodiment, the configurations of the 

matching data accumulator and matching device are 
15 similar to the configurations of the matching data 

accumulator and matching device 105a shown in the 

third embodiment. 

Fig. 8 is a block diagram showing an example 

of the configuration of a state change data generator 
20 102f where the state change data generating unit 102 

is made into an apparatus. As shown in Fig. 8, the 

state change data generator 102f contains a state 

selector 102g and calculators 102i . 

The state selector 102g is specifically 
25 realized by a semiconductor circuit for switching and 

the like. The state selector 102g, when receiving the 

input data 11 and the state (ageing) information 12, 
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sends an input image (input data) to the calculator 
102i, which carries out a neural network calculation 
for converting the input data 11 into a state other 
than the state indicated in the state information 12, 
5 among the calculators 102i. The calculator 102i is 
specifically realized by a CPU operated in accordance 
with a program. Each of the calculators 102i converts 
the input data 11 into the face image in the state 
different from the state indicated in the state 

10 information 12, and generates the state change data 
and then outputs to the matching device 105a. 

In the first embodiment, the data matching 
method executed by the data matching apparatus may 
be realized by the data matching program which can 

15 be executed on a calculating apparatus. Then, the 
data matching program may be stored in an information 
recording medium, which can be read in the calculating 
apparatus, and loaded into the calculating apparatus. 
Consequently, the data matching process indicated in 

20 the first embodiment may be executed on the 
calculating apparatus. 

For example, the data matching process may be 
executed by loading, into the calculating apparatus, 
the data matching program for instructing a computer 

25 to execute: the process for decomposing the data of 
the matching target into the configuration component 
in the predetermined state; the process for 
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converting the parameter corresponding to the 
configuration component in the predetermined state 
into the parameter in the state different from the 
predetermined state; the process for accumulating the 
5 configuration component of the data classified into 
each state and using the accumulated configuration 
component and the converted parameter and then 
generating the state change data where the 
predetermined state change is given to the data of 
10 the matching target; ancfthe process for matching the 
generated state change data with the matching data 
group accumulated by the matching data accumulating 
unit. 

Also, in the second embodiment, the data 
15 matching method executed by the data matching 

apparatus may be realized by the data matching program 
which can be executed on the calculating apparatus. 
Then, the data matching program may be stored in the 
information recording medium which can be read by the 
20 calculating appara t*u s and loaded into the calculating 
apparatus so that the data matching process indicated 
in the second embodiment may be executed on the 
calculating apparatus. 

For example, the data matching process may be 
25 executed by loading, into the calculating apparatus, 
the data matching program for instructing, the 
computer to execute: the process for generating the 
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state change data where the data in the predetermined 
state is changed into the data in the state different 
from the predetermined state, in accordance with the 
conversion using the study through the data 
classified into each state; and the process for 
matching the generated state change data with the 
matching data group accumulated by the matching data 
accumulating unit. 



